Papers with fine-tuning language models
CoTEVer: Chain of Thought Prompting Annotation Toolkit for Explanation Verification (2023.eacl-demo)
Copied to clipboard
| Challenge: | Chain-of-thought prompting generates an explanation before the final prediction, but its performance is affected by the factual accuracy of the explanation. |
| Approach: | They propose a toolkit for annotating the factual correctness of generated explanations and collecting revision data of wrong explanations. |
| Outcome: | The proposed toolkit is publicly available at https://github.com/SeungoneKim/CoTEVer. |
Knowledge of cultural moral norms in large language models (2023.acl-long)
Copied to clipboard
| Challenge: | Existing studies do not examine moral variation in a diverse cultural setting. |
| Approach: | They investigate whether monolingual English language models capture moral variation across cultures . they use data from the World Values Survey and PEW global surveys . |
| Outcome: | The proposed models predict moral norms worse than the English models reported previously . the models improve inference across countries at the expense of an accurate estimate . |
Answer is All You Need: Instruction-following Text Embedding via Answering the Question (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods for encoding instruction information fail to be sensitive to clearer criteria like “evaluate similarity based on emotion” . instead, we propose a different approach, which treats the instruction as a “question” about the input text and encodes the expected answers to obtain the representation accordingly. |
| Approach: | They propose a text embedder that captures characteristics of texts specified by user instructions clarifying the similarity criterion. |
| Outcome: | The proposed model improves instruction-following capabilities when applied to large language models and encoder-based LMs. |
HyperT5: Towards Compute-Efficient Korean Language Modeling (2023.acl-industry)
Copied to clipboard
| Challenge: | Pretraining and fine-tuning language models is a common practice in NLP, but deploying general-purpose language models without the abundant computation or data resources is proving difficult. |
| Approach: | They propose a sequence-to-sequence language model architecture that can be more practical and compute-efficient than the decoder-oriented approach. |
| Outcome: | The proposed language model outperforms competing models in Korean benchmarks and is more efficient in low-resource settings. |
RL with KL penalties is better viewed as Bayesian inference (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Reinforcement learning (RL) is used in fine-tuning large language models to penalize them for undesirable features of generated sequences. |
| Approach: | They analyze challenges associated with treating a language model as an RL policy . they find that RL is equivalent to variational inference: approximating a Bayesian posterior . |
| Outcome: | The proposed approach is flawed because it turns the LM into a degenerate distribution, the authors show . they show that the proposed approach avoids the distribution collapse problem and offers a first-principles derivation for its objective. |
Initializing and Retrofitting Key-Value Adaptors for Traceable Model Editing (2025.findings-acl)
Copied to clipboard
| Challenge: | Language models (LMs) are becoming imperative tools for consulting in realworld scenarios. |
| Approach: | They propose a model editing method that initializes and retrofits key-value pairs into MLP blocks to construct a new mapping of a piece of knowledge without damaging irrelevant knowledge. |
| Outcome: | The proposed method outperforms baseline methods on a series of GPT series models on edit success and generalization without influencing specificity. |
Neuroplasticity and Corruption in Model Mechanisms: A Case Study Of Indirect Object Identification (2025.findings-naacl)
Copied to clipboard
| Challenge: | Recent advances in transformer-based language modelling have garnered attention in widespread applications. |
| Approach: | They investigate the effects of fine-tuning on poisoned data and analyze the changes after retraining a corrupted model on the original dataset and observe neuroplasticity behaviors. |
| Outcome: | The proposed model corruption mechanisms can be generalized to longer epochs and model reforming can be performed on clean datasets. |
Low-resource Interactive Active Labeling for Fine-tuning Language Models (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing active learning methods for fine-tuning language models are underperforming in low-resource, interactive labeling setting. |
| Approach: | They propose a novel active learning method that employs a hybrid sampling strategy to minimize labeling cost and acquisition latency while providing a framework for adapting to dataset diversity. |
| Outcome: | The proposed method reduces labeling cost and acquisition latency while providing a framework for adapting to dataset diversity via user guidance. |
Making Pre-trained Language Models Better Few-shot Learners (2021.acl-long)
Copied to clipboard
| Challenge: | Recent studies show that the GPT-3 model can perform few-shots on language understanding tasks with a natural-language prompt and a few task demonstrations. |
| Approach: | They propose a technique for fine-tuning language models using a few examples . they propose LM-BFF, which uses prompt-based fine-uning and a pipeline for automating prompt generation . |
| Outcome: | The proposed approach outperforms standard fine-tuning procedures on a range of NLP tasks. |
Modelling Commonsense Properties Using Pre-Trained Bi-Encoders (2022.coling-1)
Copied to clipboard
| Challenge: | Pre-trained language models can capture commonsense properties that are rarely expressed in text. |
| Approach: | They propose to fine-tune language models to explicitly model commonsense properties . they train separate concept and property encoders on extracted hyponym-hypernym pairs and generic sentences . |
| Outcome: | The proposed model can capture commonsense properties with higher accuracy than human models . a new study shows that the model can model commonsensence properties with much higher accuracy . |
XAutoLM: Efficient Fine-Tuning of Language Models via Meta-Learning and AutoML (2025.emnlp-main)
Copied to clipboard
Ernesto Luis Estevanell Valladares, Suilan Estevez-Velarde, Yoan Gutierrez, Andrés Montoyo, Ruslan Mitkov
| Challenge: | XAutoLM is a meta-learning-augmented framework that can be used to optimize discriminative and generative LM fine-tuning pipelines. |
| Approach: | They propose a meta-learning-augmented AutoML framework that reuses past experiences to optimize discriminative and generative LM fine-tuning pipelines efficiently. |
| Outcome: | XAutoLM surpasses zero-shot optimizer’s peak F1 on five of six tasks, reduces mean evaluation time of pipelines by up to 4.5x, and uncovers 50% more pipelines above zero- shot Pareto front. |
Reasoning Like a Doctor: Improving Medical Dialogue Systems via Diagnostic Reasoning Process Alignment (2024.findings-acl)
Copied to clipboard
| Challenge: | Medical dialogue systems have attracted significant attention for their potential to act as medical assistants. |
| Approach: | They propose a framework that emulates clinicians' diagnostic reasoning processes and aligns with clinician preferences through thought process modeling. |
| Outcome: | The proposed framework generates appropriate responses that relies on abductive and deductive diagnostic reasoning analyses and aligns with clinician preferences through thought process modeling. |
Exploring Strategies for Generalizable Commonsense Reasoning with Pre-trained Models (2021.emnlp-main)
Copied to clipboard
| Challenge: | Recent work proposes lightweight updates to improve commonsense reasoning models . fine-tuning can cause models to overfit to task-specific data and forget knowledge gained during training . |
| Approach: | They propose to use lightweight models to update pre-trained language models to learn commonsense background knowledge. |
| Outcome: | The proposed models learn from commonsense reasoning datasets, but they are overfitted and limited generalized. |
Video-Grounded Dialogues with Pretrained Generation Language Models (2020.acl-main)
Copied to clipboard
| Challenge: | Pre-trained language models have shown success in improving downstream NLP tasks . pre-tuned models capture textual dependencies in text data of rich semantics . |
| Approach: | They propose a framework for improving video-grounded dialogue by extending GPT-2 models . they propose to combine visual and textual representation into a structured sequence . |
| Outcome: | The proposed framework improves audio-visual scene-aware dialogues benchmark on AVSD . it is based on a large pre-trained GPT-2 network and can generate natural responses . |
Can Machines Resonate with Humans? Evaluating the Emotional and Empathic Comprehension of LMs (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Empathy plays a pivotal role in fostering prosocial behavior, often triggered by the sharing of personal experiences through narratives. |
| Approach: | They propose to use contrastive learning with masked LMs and supervised fine-tuning with large language models to improve empathy understanding in NLP models. |
| Outcome: | The proposed methods show that there is low agreement among annotators and that cultural differences are a factor in their interpretation of empathy. |
Efficient Ensemble for Fine-tuning Language Models on Multiple Datasets (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for fine-tuning language models are efficient when adapting to a single dataset. |
| Approach: | They propose to use an ensemble method for fine-tuning a language model to multiple datasets instead of a single adapter per task. |
| Outcome: | The proposed method improves performance on multiple datasets while preserving low-rank adaptation properties. |
Towards Autonomous Tool Utilization in Language Models: A Unified, Efficient and Scalable Framework (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent advances in tool learning for large language models have led to a new trend to allow LLMs to leverage external tools. |
| Approach: | They propose a framework for fine-tuning language models that categorizes queries into three different types . they also introduce an "instruct, execute, and reformat" strategy specifically designed for efficient data annotation . |
| Outcome: | The proposed framework surpasses open-source language models and GPT-3.5/4 on multiple evaluation metrics. |
XATU: A Fine-grained Instruction-based Benchmark for Explainable Text Updates (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing text editing benchmark datasets contain coarse-grained instructions and lack explainability, resulting in outputs that deviate from intended changes. |
| Approach: | They propose a benchmark specifically designed for fine-grained instruction-based explainable text editing. |
| Outcome: | The proposed benchmark incorporates fine-grained instructions and gold-standard edit explanations. |